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ABSIBACT 

Evaluated vas a program designed to make an early 
diagnosis of the emotional problems and learning disabilities of 40 
preschool children, and to furnish educational interv/entions so that 
these problems might be ameliorated before the children enter formal 
schooling. The program centered around speech and language, 
perceptual-motor activities, and adjustment to peers and adults. 
Evaluation objectives focused on assessment of improvement of 50% of 
the participants in areas of language, perceptual-motor development, 
social and emotional behavior, and attitudes tovard and relationships 
with adults in the educational setting. Pre- and post-test data 
revealed that statistically significant differences in the direction 
of gains and improvement vere obtained. There vas also close 
agreement between staff members that over 75% of the children had 
improved moderately or markedly in attitudes toward and relationships 
with adults. (Among appended materials are statistical data and a 
sample form used to collect ratings of improvement.) (SBH) 
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CHAPTER I 



THE PROGRAM 

A pre-school program, designed to accommodate approximately 
^0 emotionally disturbed, language and perceptually Impaired 
children was carried out at PS I06M (Bellevue Psychiatric 
Hospital) between December 197^ and June 1975. The program 
was designed to make an early diagnosis of the emotional prob- 
lems and learning disabilities of pre-school children, and 
to furnish educational interventions so that these problems 
might be ameliorated before the children enter formal school- 
ing. 

The children participating in this program were referred by 
clinics, private physicians, social workers, or parents to 
the Psychiatric Unit of Bellevue Hospital. They were screened 
by the psychiatric staff, and were recommended for either 
in-patient or out-patient services. Children meeting the 
criteria for admission to the pre-school program — those with 
severe emotional and learning problems — became regular part- 
icipants. Approximately half of the children accepted into 
the program were in-patients. 

The on-site coordinator of the pre-school program was the prin- 
cipal of PS 106. The staff consisted of 2 special-class 
teachers, 2 teacher-specialists with training in speech and 
language, and perceptual-motor areaj. In addition, an 
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educational assistant was assigned to the program, assist- 
ing the teachers In routine ^activities . All of the teachers 
and teacher-specialists were highly trained and experienced; 
their areas of specialization were In early childhood and 
special education. 

Half of the children attended a morning session which was held 
from 8:20 to 11:30, while the other half of the group arrived 
for an afternoon session which began at 11:^5 and ended at 
3:00. Classes were in session from Monday to Friday each week. 
The in-patient children came to their classroom directly from 
the hospital wards. • Those children who were living at home 
were brought to the school by their parents. The parents of 
this latter group waited in the hospital until the end of the 
school session to take their children home. Many of the par- 
ents of the children living at home were seen by a psychiatrist 
or social worker in connection with their own adjustment prob- 
lems. In addition, small groups of "waiting-room" parents 
met weekly with a social worker or psychiatrist, during which 
periods discussions centered around child-training procedures 
and problems of child management. 

The major thrusts of the pre-school program centered around 
speech and language, perceptual-motor activities, and adjust- 
ment to peers and adults. For many of these children, the 
program provided the only socialization experiences in which 
they had been involved outside of their homes. Children were 
grouped in class sessions on the basis of chronological age. 
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The "toddlers" (C.A. from 2-1/2 to 3-1/2) met separately 
from the "nursery" group (C.A. from 3.6 to 5). The programs 
In the two classrooms Included group games, use of pencil 
and crayon, perceptual-motor training, listening activities, 
communication skills, and learning to share and to partici- 
pate in group activities. The two teacher-specialists worked 
with individual children or small groups of children who had 
common problems in communication and perception; their inter- 
ventions were carried on In the classrooms or in more private 
quarters. Each child received regular attention from these 
specialists. 

The role of members of the psychiatric staff did not "ertd with 
the diagnosis and referral procedures. Staff meetings , 
(psychiatrists, teachers, social workers) were held each week, 
during which a single child* s progress was considered. Video- 
tapes were available, made at admission, and repeated Ju^t 
prior to staff conferences, so that the changes in sociali- 
zation and maturation could be documented. In addition, social 
workers, psychiatrists, and psychiatric residents were in and 
out of the school, observing children in learning situations 
and consulting with, teachers. All of the children in the pro- 
gram , were seen periodically by members of the psychiatric staff. 
Thus the program encompassed a jointure of educational and 
clinical interventions. 
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CHAPTER II 



EVALUATIVE PROCEDURES 



Pour evaluation objectives for the program were contained 
in the Evaluation Design: 

1. To assess the extent to which 50% of the part- 
icipants have made statistically significant 
improvement in their ability to use language. 
'This assessment will be based on an analysis 
of the pre-test and post-test scores on the 
Utah Tetst of Language Ability, the Templln 
Sound Discrimination Test, and the Verbal 
Language Development Scale (New York Univer- 
sity). 

2/ To determine the extent to which 50?5 of the 
participants who have auditory and/or visual . 
perceptual deficits have made statistically 
significant improvement in their auditory 
and/or visual perceptual defects. This de- 
termination , will -be .based on an analysis of 
pre-test and post-test scores on the Berry 
Visual Motor Integration Test, the Illinois 
Test of Perceptual Abilities, and the Oser- 
etsky Motor Proficiency Test. 

3. To determine the extent to which 50% of the 
participants whose emotional disturbance and/ 
or cerebral dysfunction has "manifested itself 
in short attention span, hyperactivity , inabil- 
ity to cooperate in a group, and whose social 
behavior was inappropriate to their age, will 
demonstrate statistically significant improve- 
ment in overcoming these deficits. This de- 
termination will be basod upon pre-test and _ 
post-test analyses of participants scores on 
the New York University Biometric Scale and 
the California Pre-School Competency Scale. 

H. To determine the extent to wh.lch 50% of the 
participants have manifested significant im- 
provement in their attitudes and relationships 
with adults in the educational setting. This 
determination will be made on the basis of 
qualitative Judgments of members of the Belle- 
vue psychiatric staff and educational person- 
nel who work with the children. Evaluations 
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of Improvement will be based on anecdotal 
material collected during the treatment 
period. 

The evaluation design further stated that data analysis will 
use correlated t tests, run between pre- and post-test scores, 
excepting In the determinations contained In the kth object- 
ive; qualitative ratings on Improvement will be used In this 

Instance . 

^ g. 

Certain tests specified In the evaluation design were not 
administered to the participants. The Berry and Templln 
tests were eliminated because they overlapped with the functions 
tested by the ITPA. The program coordinator had submitted 
a list of tests to be used .In the evaluation, a llst« from 
which tests could be selected, rather than an Inclusive list 
of desirable tests. Since the Berry and Templln Items cov- 
ered the same functions that were evaluated by the more use- 
ful ITPA, these two tests were not Included In the testing 
program. In addition, the California Pr'e-School Competency 
Scale was not used, since It could not be supplied by the 
publisher at the time when an attempt was mad^s to purchase 
the test. 

There were two Instances of data loss, one real and one only 
apparent. On the Data Loss Form (attached to the MIR Form 
30C) It may be noted that the Utah was administered to only 
8 participants. This test was considered to be a supplement 
to the ITPA, and was administered to only a small group of 
young. Immature children who could not score meaningfully 
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on the ITPA. Pour pre-school children were not available for 
testi?ig during the post-test period when the Oseretsky was 
administered. It should further be noted that only 2^ chil- 
dren were Judged to have auditory or visual perception de- 
fects; the ITPA and Oseretsky were administered only to those 
children with deficits In these areas. (See Evaluation Ob- 
jective 2) 

The Utah, Os.eretsky and ITPA tests were administered and 
scored by Title VI teachers assigned to the program. The 
Verbal Language Development Scale was given by psychiatrists 
or psychiatric residents who had observed the children on a 
regular basis. The New York University Blometrlc Scale was 
administered by psychologists on the staff of the Blometrlc 
Center. All pre-testlng was completed during December 197^ 
or January 1975. The post-tests were administered during 
the last week In May and the first week In June. 

Scores of the pre-school children on the Utah Test of Lang- 
uage Ability, the ITPA, the Verbal Language Development Scale, 
and the New York University Blometrlc Scale were Interpreted 
In terms of the ehronologlcal-age norms supplied by the pub- 
lisher. On the Oseretsky, since most of the children scored 
below the norms for the test, the method of scoring was based 
upon the ratio between the sum of successes on each subtest 
and the number of trials. 
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CHAPTER III 



FINDINGS 

The findings of this evaluation, based upon analyses of 
differences between pre-test and post-test scores on tests 
which were administered to the pre-school children who part- 
icipated In this program, are summarized below: 

The first evaluation objective was to assess the extent / 
to which 50% of the participants have made statistically sig- 
nificant gains In their ability to use language. An analysis 
of the pre-test and post-test differences between the scores 
on the Utah Test of Language Ability and the Verbal Language 
Development Scale showed a statistically significant difference 
at the .01 level (correlated t^ design). Mean gains of 6 months 
were made on the Utah, and 5 months on the VLD Scale. (See 
Table 1) 

The second evaluation objective was to determine the extent 
to which 50% of the participants made Improvement In their 
auditory and visual perceptual defects. Data analyses of 
pre-test and post-test differences In scores on the Illinois 
Test of Perceptual Abilities and the Oseretsky Motor Profic- 
iency Test resulted In a statistically significant Improve- 
ment In perceptual functioning (correlated t design, p^? .01). 
Mean gains of 5 months were made on the ITPA, and substantial 
gains are to be noted on the Oseretsky. (See Table 1) 
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The third evaluation objective was to determine the extent 
to which 50% of the participants would have overcome hyper- 
activity, Inability to cooperate In a group, short attention 
span, and Inappropriate social behavior. By an analysis of 
pre-test and post-test differences In the scores on the 
New York University Blometrlc Scale , a statistically sig- 
nificant difference was obtained (correlated Jb design, p^.Ol). 
Mean gains of 6 months were made on the Blometrlc Scale, 
(See Table 1) 

The fourth evaluation objective was to determine the extent 
to which 50% of the participants would significantly Improve 
In their attitudes and relationships with adults In the 
educational setting. Clinicians who had followed the child 
regularly and two teachers who knew the children well made 
separate ratings on degree of Improvement. The results are 
contained In Table 2. The clinicians rated 2 children as hav- 
ing regressed; 10 who had made slight improvement , 19 who 
had made moderate Improvement, and 6 who had Improved mark- 
edly. The average of two teachers ratings described 1 child 
as having regressed; 6 who made slight improvement, 21 
who improved moderately, and 9 who improved markedly. Both 
clinicians and teachers rated over three-quarters of the par- 
ticipants as having improved moderately or to a marked degree* 
3ee Tables 2 and 3« 

The evaluation objectives centered around assessment of im- 
provement of 50^ of the participants in areas of language, 
perceptual -motor development, and social and emotional behavior • 
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Table 1 

Results: . New York University Verbal Language Scale 

Total Pre- Post- 

Component Activity Parti- Group Number test test Obtained Significance 

Code Code cipants ID Tested Mean Mean Test Value of t Level 

"69911 720 37 11 37 2.6 3.1 t 10.46 P^ .01 



Results: Utah Test of Language Ability 

Total Pre- Post- 

Coirtporient Activity Parti- Group Number test test Obtained Significance 

Code Code cipants ID Tested Mean Mean Test Value of t Level 

69911 720 37 11 10 2.3 2.9 t 6*06 p^ .01 



Results: New York University Biometric Scale 

Total Pre- Post- 

Component Activity Parti- Group Number test test Obtained Significance 

Code Code cipants ID Tested Mean Mean Test Value of t Level 

69911 720 37 11 37 2.7 3.3 t 9.61 PS. 01 



Results : Oseretsky Motor Proficiency Test 

Total Pre- Post- 

Component Activity Parti- Group Number test test Obtained Significance 

Code Code cipants ID. Tested Mean Mean Test Value of t Level 

69911 720 37 11 20 .24 .42 t .80 P^.Ol 



Results: Illinois Test of Perceptual Abilities 

Total Pre- Post- 

Component Activity Parti- Group Number test test Obtained Significance 

Code Code cipants ID Tested Mean Mean Test Value of t Level 

69911 720 37 11 24 2.713.2 t 6.93 Pi^.Ol. 
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proposal. It served the population for which it was de- 
signed. 

The program described in this report was activated during the 
present school year, so there were no recommendations forth- 
coming from prior programs . 
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Table 2 



Teachers/ Judgments of Participants* 
Improvement in Attitudes and Relationships 
with Adults In the Educational Setting 

Degree of Improvement 

Regressed Slight Moderate Marked 

1 6 ' 21 9 



Table 3 



Clinicians* Judgments of Participants* 
Improvement in Attitudes and Relationships 
with Adults in the Educational Setting 

Degree of Improvement 

Regressed Slight Moderate Marked 

2 10 19 6 
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CHAPTER IV 

SUMMARY OP MAJOR FINDINGS, CONCLUSIONS AND RECOMMENDATIONS 

A Pre-School Program for Emotionally Disturbed, Language and* 
Perceptually Impaired Children was conducted at PS 106M 
(Bellevue Psychiatric Hospital) from December 1974 to June 1975- 
The program was designed to diagnose and ameliorate the emotion- 
al and special learning problems of the children • Program 
emphases were on speech and communication skills , perceptual- 
motor training, and socialization. Children ranged In ages 
from 2-1/2 to five years and attended either morning or after- 
noon sessions of the school program. They were admitted into 
the program following psychiatric screening. Approximately 
half of the 37 participants were in-patients at the hospital. 
The others were brought to school each day by a parent. 

The educational staff of the project consisted of an on-site 
coordinator (principal of PS 106M) , two classroom teachers, and 
2 teacher-specialists who worked with children individually or 
in small groups in speech and language and perceptual training. 
The teachers were highly trained and experienced; their fields 
of specialization were in early childhood and special educa- 
tion. 

The evaluation objectives centered around assessment of im- 
provement of 50% of the participants in areas of language, 
perceptual-motor development , social and emotional behavior, 
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and attitudes toward and relationships with adults In the 
educational setting. Pre- and post-test data were collected 
on the following measures: The Utah Test of Language Ability, 
the Verbal Language Development Scale (New York University ) , 
the Illinois Test of Perceptual Abilities , the Oseretsky 
Motor Proficiency Test, and the New York University Blometrlc 
Scale. Using a correlated t design, statistically signif- 
icant differences In the direction of gains and Improvement 
were obtained on each of the above measures. (p^.Ol) 
The pre-testlng was conducted In December 1974 and January 
1975- The post-testing period Included the last week In May 
and the first week in June. The treatment' period ranged 
from 4 to 5 months. 

An additional evaluation objective was the determination of 
changes in the attitudes and relationships with adults. 
Members of the psychiatric staff and teachers assigned to the 
educational program rated participants with respect to degree 
of improvement in these areas. There was close agreement be- 
tween the disciplines, and each Judged that over 755? of the 
children had improved moderately or markedly in attitudes to- 
ward and relationships with adults in the educational setting. 

There were no discrepancies between the program as envisioned 
in the project proposal and the actual operation of the pro- 
gram. It served the appropriate target population and was 
carried out effectively by the educational staff. A unique 
aspect of the program was the close relationship between the 
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psychiatric staff of the hospital and the educational pro- 
gram. The project represented a joint effort of clinicians 
and educators, not only In the selection of children for the 
program but also in the day to day operation of the project. 



Concluding Recommendations 

1. The program should be recycled during the 
next academic year. It offers the only 
opportunity for this kind of child to 
participate in group activities and to re- 
ceive professional help for the remediation 
of his deficits In an educational setting. 
Prior* to the establishing of this program, 
In-patlent children of this age left the 
wards for only occasional periods of re- 
creation. Out-patients were shut out 

from many other pre-school programs. This 
program of a combined clinical and edu- 
cational Intervention meets a desperate 
need In the mental- health field. It Is 
Implemented with great effectiveness by a 
very competent and dedicated staff. 

2. Consideration should be given to selecting 
tests and other evaluative devices which 
are appropriate when used with a pre- 
school population. Because of develop- 
mental retardations which characterize 

Che target population, norm-referenced 
tests which are selected should contain 
Items simple enough so that measurable 
responses can be elicited from all part- 
icipants . 

3. An additional staff member should be added 
to the project to meet regularly with the 
parents who are waiting in the hospital 
during school hours until their children 
are ready to go home. The program should 
seek to become more Involved with the par- 
ents of the participants, as an adjunct 

to the educational process . 
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Pre-School Program for Emotionally Disturbed, Language and Perceptually Impaired Children 

Function No. 09-55614 

Use Table 30C. for norm referenced achievement data not applicable to tables 30A, and 30B, 

30C, Standardized Test Results 

In the table below, enter the requested information about the tests used to evaluate the effectiveness of 
major project components/activities in achieving desired objectives* Before completing this form, read all 
footnotes. Attach additional sheets if necessary. 



Component 
Code 


Activity 
Code 


lesL 
Usedi/ 


Form 


Level 


^otai, 
n2/ 
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Tested 


Pretest 


Posttest 


Statistical 
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Pre 
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37 
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.793 
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10.46 


p<.01 
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2.,3 


$97 


6/75 


2.9 


.841 


t 


6.06 


pi. 01 
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9.61 
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37 


11 


20 
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L/75 
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6/75 
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t 
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p^.Ol 
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1 
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0 


e 


e 


e 


Pre 


Sch. 


37 


11 


24 


7* 


L/75 


2.71 


.855 


6/75 
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1/ Identify Test Used and Year of Publication (HAT-58i CAT-70, etc.) IJ Test statistic (e.g., t; F; X^).: 
2/ Total number of participants in the activity 8/ Obtained value 

. 3/ Identify the participants by specific grade level (e.g., grade 3, 9/ Specify level of statistical significance 
grade 5). Where several grades are combined, enter the last two digits obtained (e.g., p£.05; p<.01). 
of the component code. 
4/ Total number of participants included in the pre and post test cal- 

5/ ri'gtSe'equivalent; 2 = percentile rank; 3 = Z Score; 4 = Standard ONLY AVAIIABIJ FORM USED FOR EACH TEST: 
■ score (publisher's); 5 = stanine; 6 = raw score; 7 = other, a. N.Y.U. Verbal Lang. Development Scale, 1968 
6/ s.D. = Standard Deviation b. Utah Test of Language Ability, 1973 

c. N.Y.U. Biometric Scale, 1970 

d. Oseretsky Motor Proficiency Test, 1946 

e. Illinois Test of Perceptual Abilities, Revised, 1968 



*Age Norms 

**Ratio of Number of Successes to number of trials 



OFFICS OF EDUCATIO!i;\L El'AlUATIOll • DAT/. LC3S FCRH 
(attach to KIR, item -WO) Function ^ 



In this' table enter all Data Loss infonnation. 
in each activity oust be accounted for* The component 
should be used here so that the two tables natch. See 



Between MIR, item #30 and this form, all participant! 
and activity codes used in completion of item ^30 
definitions below table for further instructions. 



Component 
Code 


Activity 
Code 


(1) 
Group 

I.D. 


(2) 
Test 
Used 


(3) 
Total 

N 


Number 

Tested/ 

Analyzed 


1 

participants 
Not Tested/ 
Analyzed 


(6) 

Reasons why students were not tested, or If 
tested, were not analyzed 

Number/ 




z 




leason 


6 


9 


9 


1 


1 


7 


2 


0 


Pre- 
Sch/ 


Utah* 


,37 


7 : 


■ 

■30 


80 

■ 


rhis test was administered only 
to children too voung or immatur 




to respond to ITPA. Not a true 
data loss. Used as an extension 
































of ITPA. 




In evaluation objectives, this 


13 


6 
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•7 


2 


0. 


Pre- 
Sch. 




37 


2^ 


13 . 


35 ^ 


test was to be given only to 
children' with 'auditory and "vis- ' 




ual perceptual defects. Thus 
there was not a true data loss. 




































In the evaluation objectives, 
this test was to be given only 
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6 


9 

i 


9 


1 


1 


7 


2 


0 


Pre- 
Sch. 


Oser- 

etsky 


' 37 

■ 


20 ' 


17 


^9 


to cniiaren nm auaitory ana 
visual 'defects 7 Four such chil- 




oren were not avaiiaole ror 
post-test. 





(1) Identify the participants by specific grade level {e.g., grade 3, grade 9). Where several grades are conbtned, 

enter the last two digits of the component code. itytah .Te5t of Language Ability 

(2) Identify the test used and year of publication (M/.T-70, SDAT-74, etc.).#»iiiinois Test of Perceptual Abilities 

(3) Number of participants in the activity. ***Oseretsky Motor Proficiency Test 

(4) Nuir,ber of participants included in the pre and posttest calculations found on itentf30. 

(5) Nucber and percent of participants not tested and/or not analyzed on ltemi?30, 

(6) Specify all reasons why students were not tested and/or analyzed. For each reason specified, provide a sepinte = 

nunber count. If any further documentation 1b available, please attach to this form. If further ipice li 
needed to specify and explain data loss, attach additional pages to this form. , 

Notej An "n" of 2l comprised the group of' children with auditory and visual defects. . 
Q The only small data. loss occurred in the case of the Oseretsky. The abjective jy^^ 
i ERjC called for only 50l of the participants to be, tested with ITPA and Oseretsky. 22 ' 



J 



-17- 



Measures of growth other than Standardized Tests 

This question Is designed to describe the attainment of approved objectives 
not normally associated with measurement by norm referenced standardized 
achievement tests . Such objectives usually deal with behavior that is 
indirectly observed, especially in the affective domain/ For example, a 
reduction in truancy, a positive change in attitude tox^ard learning, a 
reduction in disruptive behavior, an Improved attitude toward self (as 
indicated by repeated interviews), etc., are frequently held to be prerequisite 
to the shift toward Increased academic achievement by disadvantaged learners. 
Where your approved measurement devices do not lend themselves to reporting on 
tables 30A, B or C, use any combination of items and report on separate pages. 
Attach additional pages if necessary. 



Component Code 



Activity Code 



Objective Code 



6 


9 


9 


1 


1 




7 


OJ 


0 




CO 


0 


2 



Brief Description m inl M ar^a at thP RpTI pviip Pay nhl flt-r-t f> TTni-h AnH 

teachers assigned to the Pre-School Program for Emotionally Disturbed^ 

Lan gnagfi and Pfi- mpptnally Impaired Hhllr^rpn -ratf^d the parti fi-f pants 

In the program on Improvement In attitudes and In relationships with 
adul ts J comparing the children at the post-testing period with the 
behavior patterns noted at the beginning of the treatment period. 



Number of cases observed: 



Number of cases in treatment 



Pretreatment index of behavior (Specify scale used): Clinical and 

educ ational Impr essions , , 



Criterion of success: Fifty % of the children would show significan t 

Impr ovement In attitudes and relationships with adults. 

Was objective fully met? Yes [T] No If yes, by what criteria do you 

know? 

5^evpnty five ^ of the parti c1 pants tj^r»P judged to have 

•Imp- nr^ypd Tnndfar>a t el y nr Tnar>lfed1y 



Comments 



o 23 
ERIC 
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Function No, 09-56614 



PRE-SCHOOL PROGRAM-PS 106M 



Improvement In Attitudes and Relationships 
with Adults In the Educational Setting 

Clinician 

Educator 



Indicate by a check-mark 
the degree of Improvement 
of each child at the post- 
test period 

Degree of Improvement 



Child 



Regressed Slight Moderate Marked 



